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DIGITAL TELEVISION TRANSMISSION WITH ERROR CORRECTION 

The invention is lelated to the field of digital television transmission through a 
noisy medium with error conection. The noise in the medium results in errors in the 
5 received data which require error conection for reasonable display quality. 

Digital multimedia data streams such as MPEG streams are extremely vulnerable to 
transmission errors. If error correction is not provided, then even a one bit error could 
prevent the decoding of significant portions of die MPEG stream. Proposed digital 
television standards such as the proposed ATSC standard for DTV and the proposed DVB 

10 standard, provide forward error correction data that can correct some of the errors that 

occur during transmission. The error correction data is typically redundant data in the form 
of parity bits. The amount of errors that can be corrected by an error correction scheme, 
depends on the amoimt of error correction data that is provided in the scheme. Small errors 
such as random single bit errors are more common than large burst errors so that a small 

1 5 amount of error correction data is sufficient to corre<it most errors. Also, no practical 

amount of error correction data can eliminate all possible transmission errors. Thus, these 
proposed standards are based on a tmde off between the robustness of the error correction 
and the amount of error correction data diat has to be transmitted. 

The proposed digital television technologies provide acceptable reception for low 

20 noise transmission chaimels such as those provided by current cable and satellite television 
transmission schemes. Howev»» there is a need to provide more robust error correction for 
television transmission through noisier channels such as extended cable systems, terrestrial 

broadcast, internet transmission, cell phone transmission, and wireless network 

< 

transmission channels. 

2 5 Recently, schemes for unequal protection or prioritized protection of video data has 

been widely proposed in the literature. These schemes take advantage of the &ct diat errors 
in some portions of digital multimedia stream are more critical than errors in other portions 
of the stream. An error in an important portion of die digital multimedia stream can cause 
loss of significant data, for example, an error in the header of an MPEG video I-finme can 

3 0 prevent decoding of an entire group of video frames, an error in an audio frame can result 

in an unintelligible word. However, an error in a less important portion of die digital 
multimedia stream might not even be perceivable. 
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In proposed unequal protection schemes, die digital multimedia stream is divided 
up into different portions of different types of data ttiat contribute different amounts to the 
quality of the presentation. Then the portions of tiie type of data ttiat contributes more to 
the presentation quality are made more robust than portions of ottier types of data by, for 
5 example, providing more data redundancy or by providing for more retries to correctly 
transmit the more important types of data. Commonly in these schemes, the transmission 
channel tiiat is used to transmit the multimedia stream is divided time-wise for the different 
portions of the video signal. 

A channel is a portion of a communication resource tfarougih which communication 

1 0 signals can be transmitted, the transmission of signals through one channel being 

substantially indepradent of any transmission of other signals dirough other channels of die 
communication resource. A channel communication is a signal transmission through a 
channel. A channel has predetermined properties such as a predetermined transmission rate 
or bandwidth that is substantially independent of communications through other channels. 

15 For example, a channel may be a conductive path through which electrical signals are 

transmitted or a frequency band over which electro-magnetic signals are transmitted. Only 
one transmitter at a time can transmit information through the same channel. The resource 
may be a medium or a series of different mediums. A Channel may be divided or sliced 
into multiple channels, for example, by time slicing and/or frequency slicing a channel, so 

2 0 that different transmitters can independently transmit different signals through different 

slices of the same channel. Each slice of a channel that provides substantially independent 
transmission i^ also referred to as a channel. Herein, channels are defined from the 
viewpoint of the transmitter and receiver. That is, a communication resource through which 
a signal is transmitted is considered a channel as long as the transmission and reception of 
25 die signal is substantially independent of the communication dirough otter channels. 

Communications through switched packet networks, like the internet, are not 
restricted to channels widiin the switched packet network, but typically such 
communications aro restricted to channels into and out of the internet so diat they meet the 
above definition for channel communication. 

3 0 Those skilled in the art are directed to the following citations y^hich are hereby 

incotporated in whole by rei^rence. 
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• "PES packets and elementaxy streams" in "Comprehensive MPEG2 Video 
Compression Tutorial" by Wayne E. Brefl and Mark Fimof]^ January IS, 2000, at 
www.bretl.com 

• "ATSC Standard A/S3: Digital Television Standard", August 2001, at 
5 ht^*7/www.atsc.oTg 

In the multimedia stream transmitter of the invention, the stream tiansmitter 
receives a standard multimedia data stream. Ihe stream contains encoded multimedia data 
and uniform error correction data that is useful for error correcting the encoded multimedia 
data. The uniform erroT correction data provides substantially the same robustness of error 

1 0 correction for each portion of the encoded multimedia data of the standard multimedia data 
stream. The transmitter selects some stream portions of the encoded multimedia data 
stream but not other stream portions of the encoded multimedia data stream. The selection 
depends on the importance of the selected stream portions to the correct decoding of the 
encoded multimedia data. The tiansmitter generates selection map data indicating which of 

15 the stream portions were selected. The transmitter also generates additional unequal error 
correction data for error correcting the selected stream portions and does not generate such 
additional unequal error correction data for the otiier stream portions that were not selected. 
The transmitter transmits the standard multimedia stream through a first chatmel and 
transmits enhancement data including the selection map data and the additional unequal 

2 0 error correction data through a second channel. The second chaimel is a different chamiel 
than the first channel, that is, the transmission of information signals through the first 
channel is independent of the transmission of information signals tiirough the second 
channel. 

In the multimedia data stream receiver of the invention, the receiver receives the 

2 5 standard multimedia data stream firom the first chaimel, and the enhancement data from the 

second chatmel. The receiver selectively error corrects the selected portions of the standard 
multimedia data stream according to the selection map data using the additional unequal 
error correction data. The receiver also uniformly error corrects all the encoded multimedia 
data using the uniform error correction data. 

3 0 The advantages of the combination of uniform error correction in combination with 

additional unequal error protection for critical portions of the multimedia data include that 
most errors in the less critical portions of the multimedia data are corrected while even 
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mote extensive eirois are corrected in moie critical portions of the encoded multimedia 
data. The advantages of transmitting the standard multimedia data stieam with uniform 
enror correction through a first channel and die unequal error correction through die second 
channel include that the standard multimedia data stream with uniform error conection is 
5 compatible with a receiver that only receives the standard stream firom the first channel and 
does not receive the enhancement data firom the second channel. Thus die transmitter of the 
• invention can be used for a standard receiver that does not utilize the invention. In a 
broadcast embodiment where multiple receivers at different locations receive signals fix>m 
the same transmitter of the invention, and some receivers receive a noisier signal than other 

10 receivers, the receivers that receive the noisier signal can utilize the invention to obtain 
improved quality of reception, while less complex receivers that do not utilize the 
invention, can be used to receive a less noisy signal. 

The transmitter may generate third error correction data portions useful for error 
correcting the enhancement data. The third error correction data can provided substantially 

15 the same uniform robustness of error correction for each portion of the enhancement data. 
The receiver may error correct the enhancement data before error correcting the selected 
portions of the standard stream. The transmitter may generate an enhancement stream of 
enhancement transmission j&ames. Each enhancement transmission firame may include a 
fixed-size portion of the enhancement data and a fixed-size portion of the third error 

20 correction data. ' 

The standard stream may contain fixed-size elementary stream packets, the packets 
each containing a packet header and a packet data portion. The packets may include video 
packets which contain video data in their packet data portion and audio packets which 
contain audio data in their packet data portion. 

2 5 The standard stream may be organized into fixed-size standard transmission firames, 

each standard transmission fiame containing a fixed-size portion of the encoded 
multimedia data and a fixed-size portion of the uniform error correction data. The uniform 
error correction data contained in each finame may be for error correcting the encoded 
multimedia data contained in the same fiame. 

30 The standard transmission firames may be logically organized into groups of 

multiple standard transmission firames for efficientiy generating and organizing selection 
map data and unequal error correction data for the selected portions of encoded multimedia 
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data. The selecting of portions of encoded multimedia data may include: selecting 
substantially all the audio portions; selecting substantially all the video portions that 
contain video header infonnation; and selecting sequences of video portions immediately 
following each video portion containing flie video header data, Ae number of portions in 
5 the sequence depending on a predetermined bit rate for flie second transmitting. The 
selection map data and/or unequal error correction data may each be transmitted in flie 
same order as the encoded multimedia data portions for which tfiey are generated are 
transmitted. Alternatively, the selection map data and/or unequal error correction data may 
be transmitted in an interleaved order with respect to the order that the encoded multimedia 

1 0 data portions for which they are generated are transmitted. 

The enhancement data for each group of standard transmission frames may be 
organized into multiple fixed-size enhancement data transmission portions. A 
corresponding fixed-size third error correction portion may be generated for each 
enhancement data transmission portion. An enhancement data stream of fixed-size 

1 5 enhancement transmission firames may be generated by the transmitter, with each of 
multiple enhancement transmission fi^ies containing one of the enhancement data 
transmission portions and one of the third error correction portions for the group of 
standard fiames. The fliiid error correction portion in each enhancement transmission 
frame may be for error correcting the enhancment data contained in the same 

2 0 enhancement transmission frame. 

Each enhancement data transmission portion may contain a fixed-size portion of the 
selection map data and a fixed-size portion of the additional unequal error correction data. 
Alternatively, all flie selection map data may be sent toother in subsequent sections of the 
enhancement data transmission portions and also all the additional unequal error correction 
25 data may be sent togettier in other subsequent sections of the enhancement data 
transmission portions. 

The selected stream portions may include audio portions and video portions and the 
selection may include selecting substantially all of flie audio portions and selecting all the 
video portions that contam video header mformation and selecting sequences of video 

3 0 portions that inmiediately follow the video portions that contain header information, Oie 

size of flie sequences depending on a predetermined bit rate for the transmission of ttie 
enhancement data stream. 
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In the case where ttie packets aie oiganized into multiple segments and ttie selected 
stream portions are packet segments^'then ttie selected stream portions should also include 
&e packet header of any packet containing a selected packet segment 

The standard multimedia data stream may be transmitted through the first channel 
5 by using the standard multimedia data stream to modulate a first analog carrier wave at a 
first carrier firequency and transmitting the first modulated carrier wave through a physical 
media. The enhancement data stream may be transmitted dirougli a second channel by 
using the enhancement data str^un to modulate a second analog carrier wave at a second 
carrier fiequency that is different than ttie first carrier frequency and transmitting the 
1 0 second modulated carrier wave tfarou^ the physical media. 

Additional aspects and advantages of the invention will become readily apparent to 
those skilled in the art fix>m die detailed description below with reference to Oie following 
drawings. 

Figure 1 shows an example embodiment of the multimedia transmitter of the 
15 invention. 

Figure 2 illustrates a portion 120 of an example standard multimedia data stream. 

Figure 3 illustrates an example group of 4 standard firames in which the uniform 
error correction data for error correcting packets is interleaved. 

Figure 4a illustrates an example of die selection of portions in a group of 4 standard 
2 0 transmission frames of die standard multimedia data stream in the invention. 

Figure 4b illustrate a first example embodiment of the selection map data for the 
selected portions of figure 4a. 

Figure 4c illustrates a first example embodiment of the unequal error correction 
data of the invention. 

2 5 Figure 4d illustrates another example embodiment of the selection map data of the 

invention in which the selection map data is interleaved with respect to the order of the 
portions of the standard stream for which the selection map data was generated. 

Figure 4e illustrates another example embodiment of the unequal error correction 
data of die invention in which the unequal error correction data is interleaved widi respect 

30 to the order of portions of the standard stream for which the unequal error correction data 
was generated. 
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Figure S illustrates an example embodiment of an enhancement transmission fiame 
of the invention. 

Figure 6a illustrates a first example embodiment of the or^mization of the selection 
map data and unequal raxir correction map data into the enhancCTient data transmission 
5 portions of a group of enhancement transmission fiames for the group of standard 
transmission frames shown in figure 4a. 

Figure 6b iUustmtes a second example embodiment of flie organization of the 
selection map data and additional unequal error correction data into the enhancement data 
transmission portions of a group of enhancement transmission frames for the group of 
1 0 standard transmission frames shown in figure 4a. 

Figure 7 illustrates a more detailed example embodiment of the multimedia 
transmitter of the invention. 

Figure ,8 shows an example embodiment of the multimedia receiver of flie 
invention. 

15 Figure 9 illustrates a more detailed embodiment of the multimedia receiver of the 

invention. 

Figure 10 is a flow diagram illustrating an example embodiment of the method of 
the invention. 

In the following descriptions of the drawings, the use of the same labels in different 
2 0 figures indicate similar apparatus. 

Figure 1 shows an example embodiment of the multimedia transmitter 100 of the 
invention. Receiver 1 10 provides multimedia data to signal processor 1 12. A standard 
multimedia data stream is provided by receiver 110 alone or m combination with signal 
processor 1 12. The standard stream includes encoded multimedia data and uniform error 

2 5 correction data. The imiform error correction data provides substantially fbR same 

robustness of error correction for each portion of the encoded multimedia data. 

Receiver 110 may include for example, an ii^ut for receiving multimedia data, a 
media drive to read multimedia data from a record carrier, and a camera and microphone 
for receiving the multimedia data from tiie enviroimient The receiver may receive the 

3 0 standard multimedia data stream; or the receiver may receive encoded multimedia data in 

which case, the signal processor generates tiie error correcting data and formats the 
encoded multimedia data and error correction data into the standard multimedia steam; or 



7 



US030399 

r 



the receiver may only provide raw muHiinedia data in which case, flie signal processor also 
encodes Ae raw data into encoded multimedia data. 

Signal processor 112 selects some stream portions of the standard multimedia data 
stream but not other stream portions of the standard multimedia data stream. The selection 
5 depends on the importance ofthe type ofdata contained in the stream portions to the 
quality of the presentation of die multimedia data. The signal proctor also generates 
selection map data mdicating which of die stream portions were selected. The signal 
processor also generates additional unequal error correction data for the selected stream 
portions and not for other stream portions that were not selected. 

1 0 Transmitter 1 14 transmits the standard multimedia data stream into a first channel, 

and transmits enhancement data including die selection map data and the additional 
unequal error correction data into a second channel. The second channel is a different 
channel than the first channel. Thus, both uniform error correction data and unequal error 
correction data are provided for the selected portions of the standard stream, and at least 

15 uniform error correction data is provided for the portions of die standard stream that are not 
selected. 

Figure 2 aiustcates a portion 120 of an example standard multimedia data stream. 
The standard stream may for example, conform to a proposed ATSC DTV standard or a 
proposed DVB standard. The stream may consist of sequentially fixed-size standard 

2 0 transmission fiames. Each standard fiame may contain a fixed-size multunedia data portion 

122 of encoded multimedia data followed by a fixed-size uniform error correction portion 
124 of uniform error correction data diat can be used for error correcting the encoded 
multimedia data. The error correction data in the standard fiame may be for example, 
forward error correction (FEC) data. The encoding may be for example, MPEG type 
25 encoding (e.g. MPEG-2 encoding) in which case, the encoded multhnedia data consists of 
fixed-size 188 byte elementary stream packets, each packet having a packet header and a 
packet data portion, the packet headmg includmg an ID, die packet data portions 
containing the encoded multimedia data. For an MPEG encoded standard stream, each 
multimedia data portion may contain a fixed mtegral number of MPEG packets. For 

3 0 television, the packets of an MPEG stream typically include video packets wifli packet data 

portions containing only video data and audio packets with packet data portions contaimng 
only audio data. 
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The error correction data in eacli standard frame may be for error correcting the 
encoded multimedia data only in diat same standard fiame, or it may also be for error 
correcting the encoded multimedia data in o&er standard frames. Figure 3 illustrates a 
group of 4 standard frames in which the miifoim error correction data for error correcting 
5 packets is interleaved in different order dian the order of the packets in the standard frames. 
For example in figure 3, uniform error correction data B', C and D' for error correcting 
respective packets B, C and D are contained in different standard frames of the group of 
frames than packets B, C» and D. 

Channels are considered to be different when the transmission of a data signal in 
1 0 one channel is substantially independent of the transmission of a data signal in another 

chaimel. For example, in broadcasting, channels are typically different frequency bands of 
die electro-magnetic spectra, while in TDMA cellular systems different channels are often 
different predetermined time slices of the same frequency band. In spread spectrum 
communications (such as CDMA cellular systems), a channel includes time slices of 
15 multiple frequency bands. However, a scheme for dynamic allocation of the same channel 
to multiple transmitters depending on varying data rates would not be considered 
substantially independent transmission. 

For example, transmitter 1 14 can use the standard multimedia stream to modulate a 
first analog carrier wave at a first frequency and transmit the modulated carrier wave into a 
20 medium and then use the enhancement data stream to modulate a second analog carrier 
wave at a second frequency that is different than the first frequency and transmit the 
second modulated carrier wave into the medium. In this case die medium could be any 
substance that can trananit waves such as sound or electro-magnetic waves. The 
transmitter may, for example, include a laser for transmitting light waves through an 
25 optical fiber, or an anteima for transmitting radio waves or micro waves through space. 

Figure 4a shows an embodiment of a group of 4 standard transmission frames of the 
standard multimedia data stream with selected portions of the standard stream indicated by 
letters. Portions of the standard stream that were not selected are blank. The selected 
portions may include portions of die imiform error correction data or selection may be 
3 0 restricted to include only die encoded multimedia data as shown in figure 4a. The selected 
portions may be MPEG packets or they may be packet segments which are subdivisions of 
the MPEG packets. For example, if die packets each contains 188 bytes, then each packet 
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can be logically subdivided into 6 packet segments wheiein the first 5 packet segments 
each contain 32 bytes and the 6th packet segment contains 28 bytes. 

The number of standard firames in a group (i.e. group size) depends on tradeoff 
among delay, buffering requirements, and bandwidth efficiency. For example, a larger 

5 group of standard frames, introduces more delay in processing flie standard fiames (and 
delay in processing tfie enhancement data), and requires larger bufifers to hold the data, but 
results in more efiScient packaging of the enhancement data resulting in hi^er bandwidfli 

* efiiciency. 

Figure 4b illustrates a first example embodiment of the selection map data of the 

10 invention, the selection map data being for the selected portions shown of figure 4a- In this 
embodiment, the selection map is a bit map in which a 1 indicates that a corresponding 
portion of the standard j&ame was selected and a 0 indicates that the corresponding portion 
of the standard frame was not selected. The O's are not shown in figure 4b in order to 
simplify the illustration. 

1 5 Figure 4c illustrates a first example embodiment of the unequal error correction 

data of die invention. Figure 4c shows the error correction data for error correcting flie 
selected portions of figure 4a. For example, error correction data A*, B*, C are for error 
correcting selected packets A, B, C respectively in the standard firames of figure 4a. 

Figure 4d illustrates another example embodiment of the selection map data of the 

2 0 invention in which, the selection map data is interleaved with respect to the order of the 
portions of the standard stream for which the selection map data was generated. For 
example, the first four bits in the first row of die selection bit map of figure 4d indicates 
whether the first packet of each of tiie 4 standard firames were selected. 

Figure 4e illustrates another example embodiment of the unequal error correction 

2 5 data of the invention in which tiie unequal error correction data is interleaved with respect 
to the order of portions of the standard stream for which the unequal error correction data 
was generated In figure 4e, the first two portions of unequal error correction data A* and 
M' are for error correcting packets A and M respectively. Alternatively, the selection map 
data may be in the form shown in figure 4b while die unequal error correction data may be 

30 in die form shown in figure 4e so that tiie unequal error correction data in interleaved with 
respect to the selection map data. 
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In figure 1, signal piocessor 1 12 may also generate third error correction data for 
error correcting the enhancement data. The third error correction data provide substantially 
the same uniform error correction for all of tiie enhancement data. In this case, transmitter 
1 14 would also transmit the third error correction data wifli the enhancement data througji 
5 the second channel. 

Signal processor 112 may organize the enhancement data into an enhancement data 
stream of fixed-size enhancement transmission ftames. Figure 5 illustrates a portion of an 
example embodiment of an enhancement data stream. Each enhancement transmission 
ftame consisting of a fixed-size enhancement data transmissi<m portion 132 containing 

1 0 enhancement data and a fixed-size third error correction transmission portion 1 34 

containing third error correction data for error correcting the enhancement data. In this 
case, transmitter 1 14 would transmit die enhancement stream into the second channel. 

The third error correction data in each enhancement transmission ftame may be 
forward error correction data. The error correction data in each enhancement transmission 

15 frame may be for error correcting the enhancement data in that same enhancement 
transmission frame, or it may also be for error correcting enhancement data in other 
enhancement transmission frames in a manor similar to the interleaving of error correction 
data in die standard frames in figure 3. 

Figures 6a and 6b illustrate different example embodiments for organizing die 

2 0 selection map data and unequal enhancement map data into the enhancement data 

transmission portions of a group of enhancement transmission frames for the group of 
standard transmission^frames shown in figure 4a- The number of frames in a group of 
enhancement transmission frames will depend on die number of frames in the 
corresponding group of standard frames and on the proportion of the portions of the 

2 5 standard frames that are selected for providing the additional unequal error correction, hi 
figure 6a, each of the 3 enhancement transmission frames includes a fixed-size portion 142 
of the selection map data of figure 4b followed by a fixed-size portion 144 of the unequal 
error correction data of figure 4c followed by a portion 146 of the diird error correction 
data. In figure 6b subsequent portions 150 and 1 52 of selection map data are contained in ' 

30 the first two enhancement transmission frames. The selection map data is followed by 

subsequent portions 154 and 156 of unequal error correction data. Typically, flie selection 
map data will be much smaller than unequal error correction data. 
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The signal processor 112 selects ttie portions of flie standard multimedia data 
stream that contain (he most important ^es of data for maintaining the quality of fte 
multimedia presentation. The most inqjortant portions of the data depends on tfie type of 
multimedia data contained in the standard data stream. Audio portions should be selected 
5 because flie audio data is typically only a small proportion of the multimedia data and 
audio is generally more important to flie understanding of multimedia presentation than 
other portions. Even relatively small losses of audio data can render an presentation 
unintelligible. For axi MPEG based standard stream of packets, the audio packets can be 
identified by tiie packet ID. Also, video portions contammg header information should be 

1 0 selected because header information is critical for decoding other video data. The video 
header information in a typical MPEG video stream includes frame headers. sKce headws, 
macroblock headers, and block headers. For an MPEG based standard stream, the packets 
have to be parsed to identify portions containing video headers. Finally, sequences of 
subsequent video portions (that immediately follow any video portion that contains header 

15 information) should also be selected, the number of video portions in the sequences of 
video portions may depend on a predetermined criteria. The predetermined criteria may 
include a proportion of the packets that are to receive enhanced protection, the proportion 
of packets being dynamically adjusted to at least approximately provide a predetermined 
bit rate for the second transmitting. 

2 0 When the standard multimedia signal consists of packets and the packets are 

logically subdivided into segments which are the portions that are selected, then when any 
segment of a packet is selected, then the packet headers for the selected segments should 
also be selected, because the packet header is critical for decoding the packet 

Figure 7 illustrates a more detailed example embodiment of the multimedia 

25 transmitter 200 of the invention. Receiver 202 provides raw multimedia data. Encoder 204 
converts tiie raw multimedia data into encoded multimedia data. Error correction coder 206 
generates uniform OTor correction data for tiie encoded multimedia data, tiie uniform error 
correction data providing substantiaUy ttie same robustness of error correction for each 
portion of the encoded multimedia data. Multiplexer 208 formats the encoded multimedia 

30 data and the uniform error correction data to provide a standard multimedia data stream. 
Selector 210 selects some stream portions of the standard multunedia data stream but not 
other stream portions of the standard multimedia data stream for additional unequal error 
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coirection, and generates selection map data indicating which of die stream portions were 
selected for die additional unequal error correction. The selection depends on die 
importance of die type of data contained in die stream portions to die quality of die 
presentation of the multimedia data. Error correction coder 212 generates additional 
unequal error correction data for the selected stream portions indicated hy the selection 
map data and not for other stream portions diat were not selected. Multiplexer 214 formats 
the unequal error correction data and the selection map data together to provide 
enhancement data transmission portions. Error correction coder 216 generates third error 
correction data for error correcting the enhancement data transmission portions. 
Multiplexer 218 formats the enhancement data transmission portions and enhancement 
error correction data together to provide an enhancement data stream. The data stream may 
consist of enhancement transmission frames as described above in relation to figure S. 

Transmitter 220 transmits the standard multimedia data stream into a first chaimel, 
and transmitter 222 transmits the enhancement data stream into a second chaimeU the 
second channel being different than the first channel. 

The elements of the embodiment of figure 7 are described as separate components 
but in an efficient design, portions of the components may be shared, and it is expected diat 
in a commercial embodiment, some portions of the multimedia transmitter will be 
implemented in software and other portions will be implemented in hardware. 

Figure 8 shows an example embodiment 230 of the multimedia receiver of the 
invention that uses both the uniform error correction data and the unequal error correction 
data for error correcting a standard multimedia data stream. Receiver 232 receives a 
standard multimedia data stream from a first channel, the standard stream containing 
encoded multimedia data and uniform error correction data. Receiver 232 also receives 
enhancement data including selection map data and unequal error correction data from a 
second charmel, die second chaimel being different than the first chaimeL 

Processor 234 first error corrects portions of the standard stream according to the 
selection map data using the additional unequal error correction data. The selection map 
data indicates which portions of the standard stream are to be corrected in the first 
correcting and which other portions of the standard stream are not be corrected in the first 
correcting. Processor 234 also second error corrects all the encoded multimedia data using 
the uiuform error correction data, the uniform error correcting providing substantially the 
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same robustness of error correction for each portion of fhe multimedia data of the standard 
stream. Any portion of tiie multimedia data tiiat can not be error corrected may be 
discarded. Transmitter 236 outputs the error corrected encoded multimedia data to a 
medium after the first and second error correcting of ttie data. Transmitter 236 may 
include: a display for presenting the multimedia data to an audience, a recorder for 
recording tiie multimedia data on a record carrier^ an optical laser transmitter for 
transmitting die multimedia data tiirough an optical cable, an antenna for transmitting the 
multimedia data tiirougih space, and/or any otiier type of media into which signals can be 
transmitted. 

Eitiier the uniform error correction or the unequal error correction may preformed 
first on each portion of die multimedia data. However, if portions of the uniform error 
correction data were selected for additional imequal error correction, then they should be 
error corrected before they are used for the uniform error correction. 

The enhancement data received by receiver 232 firom the second channel may be in 
any of the forms of the enhancement data described as being transmitted by transmitter 1 14 
of figure 1 or transmitter 222 of figure 7. For example, it may accompany third error 
correction data or it may be formatted into enhancement transmission ficames as described 
above. 

The output of transmitter 236 may be the error corrected standard multimedia data 
stream or just the error corrected multimedia data without the uniform error correction 
data. 

Signal processor 234 may also decode the encoded multimedia data to provide raw 
multimedia data. In that case transmitter 236 may include a simple presentation device (e.g. 
a television without an MPEG decoder) for presenting the decoded multimedia data to an 
audience. 

Figure 9 illustrates a more detailed embodiment of the multimedia receiver of die 
invention. A first receiver 2S2 receives a standard multimedia data stream fitom a first 
channel. The standard stream contains encoded multimedia data and uniform error 
correction data for error correction of the multimedia data. The uniform error correction 
data provides substantially tiie same robustness of error correction for each portion of die 
encoded multimedia data. 
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Second receiver 254 receives enhancement data including selection map data and 
additional unequal error conection data firom a second channel. The second receiver also 
receives third error conection data from the second channel. The second channel is a 
different charmel fban the first charmeL 
5 First error correction unit 256 error corrects the enhancement data using Oie third 

error correction data. Second error correction unit 258 provides a first error correcting of 
portions of the standard data stream according to the selection map data using the 
additional unequal error correction data. Third error correction unit 260 provides a second 
error correcting of the encoded multimedia data using the uniform error correction data. 

1 0 Decoder 262 converts the encoded multimedia data (after tiie first and second error 
correcting) into decoded (raw) multimedia data. Transmitter 264 outputs the decoded 
multimedia data after the first and second error correcting of the data. 

Figure 10 is a flow diagram illustrating a specific example embodiment of the 
method of tiie invention. In step 302 raw multimedia data is provided. Raw means that the 

15 data is not yet encoded. The raw data may be provided from a data capture devices such as 
a cameras and microphones or other well known methods may be used for providing 
multmiedia data. The raw data may be analog or digital data. In step 304 tiie multimedia 
data is encoded to provide encoded multimedia data. MPEG encoding may be used for 
compressing video. There are a large number of currently used and proposed mefliod for 

2 0 encoding multimedia data that could be used in die invention. The encoding may include 
digitalizing analog multimedia data. In step 306, uniform error correction data is generated. 
The uniform error correction data is usefiil for error correcting the encoded multimedia 
data. The uniform error correction data provides substantially the same robustness of error 
correction for all portions of the encoded multimedia data. In step 308, a standard 

2 5 multunedia data stream of sequential standard transmission fi:ames is generated. Each 

standard fiiame contams a fixed-size portion of tiie encoded multimedia data followed by a 
fixed-size portion of the uniform error correction data. 

In step 310, some stream portions of flie standard multimedia data stream are 
selected but other stream portions of die multimedia data stream are not selected. The 

30 selection depends on the importance of the type of data contained in tiie stream portions to 
tiie quality of the presentation of flie multimedia data. In step 312, selection map data 
indicating which stream portions were selected is generated. In step 314, additional 
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unequal error correction data is generated for each selected stream portion and not for the 
other stream portions that were not selected. Thus» additional unequal error correction data 
is provided for the more important portions of the standard stream. 

In step 316, fliird error correction data is genmted for error correcting die 
enhancement data. The enhancement data includes the selection map data and the 
additional unequal error correction data. The third error correction data provides 
substantially the same uniform error correction for all portions of the enhancement data. In 
step 318, an enhancement data stream of fixed-size enhancement transmission firames is 
generated, each enhancement transmission firame contains a fixed-size portion of 
enhancement data and a fixed-size portion of the imiform error correction data. 

In step 320, the standard multimedia data stream is transmitted into a first channel 
of a medium. In step 322 the enhancement data stream is treuasmitted into a second channel 
of the same or a different medium. The second channel is a different channel than the first 
channel. 

In step 324, the standard multimedia data stream is received from the first channel. 
In step 326, the enhancement data stream is received from the second charmel. In step 328, 
the enhancement data is error corrected using the third error correction data of the 
enhancement data stream. In step 330, the selected stream portions are error corrected 
according to the selection map data using the additional unequal error correcting data. In 
step 332, all of the encoded multimedia data portions are error corrected using the uniform 
error correction data. 

The invention has been described above in relation to specific example 
embodiments. Those skilled in the art will know how to modify these example 
embodiments within the scope of the invention herein. The invention is only limited by the 
following claims. 
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CLAIMS 

1 . A method comprising; 

providing a standard multimedia data stream, the stream containing encoded 
multimedia data and standard unifonn error collection data for error correcting the encoded 
multimedia data, the uniform error correction data providing substantially the same 
uniform error correction for each portion of the encoded multimedia data; 

selecting some stream portions of the standard multimedia data stream but not other 
stream portions of the multimedia data stream for additional unequal error correction, the 
selection depending on the importance of the type of data contained in tiie stream portions 
to the quality of the presentation of the multimedia data; 

generating selection map data indicating which stream portions were selected for 
the additional unequal error correction; 

generating additional unequal enor correction data for corresponding selected 
stream portions and not for tiie other stream portions tiiat were not selectei^ 

first transmitting tiie standard multimedia data stream with the uniform error 
correction data into a first channel; 

second transmitting enhancement data mcluding the selection map data and the 
additional unequal error correction data into a second channel, the second channel being a 
differmt channel than the first channel; 

whereby for the selected stream portions, both uniform error correction data and 
additional unequal error correction data are transmitted, and for tiie otiier stream portions, 
only uniform error correction data are transmitted. 

2. The metiiod of claim 1 wherein providing a standard stream includes: 
providing raw multimedia data; 

encoding the raw multimedia data to provide encoded multimedia dati^ 
generating uniform error correction data for the encoded multimedia data, the 

uniform error correction data providing substantially tiie same robustness of error 

correction for all portions of the encoded multimedia data; and 

generating the standard multimedia data stream of sequential standard transmission 

frames, each standard frame containing a fixed-size portion of the encoded multimedia data 

followed by a fixed-size portion of the uniform error correction data. 
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3. The method of claim 2 wheiein: 

flie encoded multimedia data includes elementary stream packets; 

tihe packets each contain a packet header and a packet data portion; 

Ae packets include video packets and audio packets, the packet data portions of the 
video packets containing video data and the packet data portions of audio packets 
containing audio data; 

each standard transmission frame contains the uniform error correction data 
generated for error correcting tiie encoded multimedia data contained in the same standard 
fiame; 

the uniform error correction data includes forward error correction data; and 
ttie standard multimedia data stream conforms with a ATSC DTV standard or a 
DVB standard. 

4. The method of claim 1 wherein: 

flie method further comprises generating third error correction data for error 
correcting the enhancement data, the third error correction data providing substantially flie 
same uniform error correction for all of the enhancement data; and 

the second transmitting includes transmitting the third error correction data with the 
enhancement data through the second channel. 

5. The method of claim 4 wherein: 

the method fiurttier comprises generating an enhancement data stream of fixed-size 
enhancement transmission frames, each enhancement traiismission frame containing a 
fixed-size portion of enhancement data and a fixed-size portion of the uniform error 
correction data, the enhancement data including the selection map data and the additional 
unequal error correction data; and 

the second transmitting includes transmitting the enhancement data stream tinough 
the second channel. 
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6. The method of claim S wherein: 

fhe multimedia stream includes audio portions containing audio data and the more 
important stream portions that are selected include substantially all fhe audio portions; 

ttie third error correction data contained in each of multiple enhancement 
transmission fiames is for error correcting the enhancement transmission data of the same 
enhancement transmission frame; 

ttie additional unequal error correction data is transmitted in the same ord^ as flie 
portions of the standard data stream for which it was generated; and 

flie imiform error correction data and the additional unequal error correction data 
and the fliird error correction data each include forward error correction data. 

7. The method of claim 1 wherein: 

the first transmitting includes using the standard multimedia data stream to 
modulate a first analog carrier wave at a first frequency and transmitting the modulated 
carrier wave ttirough a medium; and 

the second transmitting includes': 

generating an enhancement data stream containing the selection map data and the 
imequal error correction data; and 

using the enhancement data stream to modulate a second analog carrier wave at a 
second frequency that is different than the first frequency and transmitting the second 
modulated carrier wave through the medium. 

8. The method of claim 1 wherein: 

the standard multimedia data stream is organized into fixed-size standard 
transmission frames; 

fhe method furdier comprising: 

logically organizing the standard tcansmission frames into groups of multiple 
sequential standard transmission frames; 

logically organizing the selection map data and the additional unequal error 
correction data for the group of sequential standard transmission frames into corresponding 
groups of multiple fixed-size sequential enhancement data transmission portions; 

the second transmitting includes transmitting the enhancement transmission frames. 
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9. The method of claim 8 i^eiein: , 

for a group of enhancement data tiansmission portions, each enhancement data 
transmission portion includes a fixed-size portion of the selection map data and a fixed-size 
portion of the additional miequal error correction data for the corresponding group of 
sequential enhancement transmission frames. 

10- The method of claim 8 wherein for a group of standard transmission ficames, all the 
selection map data is packed into sequential sections of the enhancement data transmission 
portions, and then the unequal error correction data is packed into subsequent sequential 
sections of the enhancement data transmission portions. 

1 1 - The method of claim 8 wherein: 

sequential sections of the additional unequal error correction data are interleaved 
with respect to ttie order of the corresponding selected portions in the group of standard 
transmission frames. 

12. The method of claim 1 wherein: 

the selected stream portions include video portions containing video data and audio 
portions containing audio data; and 

selecting the stream portions includes: 

selecting substantially all of the audio portions; 

selecting substantially all of the video portions that contain video header 
information; and 

selecting sequences of video portions inmiediately following the video portions 
containing header information, the number of video portions in the sequences of video 
portions depending on a predetermined criteria related to a predefined bit rate for the 
second transmitting. 

13. The method of claim 12 wherein: 

tiie stream portions being fixed-size packets, each packet containing a packet 
header and a packet data portion, the audio data being packed into the packet data portions 
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of audio packets and the video data being packed into the packet data portions of video 
packets; 

the video header information including: frame headers, slice headers, macroblock 
headers, and block headers; 

the predetermined criteria includes a proportion of flie packets diat are to receive 
enhanced protection, the proportion of packets being dynamically adjusted to at least 
approximately provide a predetermined bit rate for the second transmitting. 

14. The method of claim 12 wherein: 

the standard multimedia data stream is organized into fixed-size packets, each 
packet contdning a packet header and a packet data portion, the audio data being packed 
into the packet data portions of audio packets and the video data being packed into the 
packet data portions of video packets, the packets each being logically divided multiple 
packet segments; 

the selecting of multimedia data portions includes: 

selecting substantially all the packet segments of flie audio packets; 

selecting substantially all the packet segments that contain video header 
information; 

selecting sequences of packet segments containing video data that immediately 
following the packet segments containing video header information; and 

selecting the packet segments containing the packet headers of any packets in 
which any packet segments are selected. 

1 5. The method of claim 1 , further comprising: 

receiving the standard multimedia data stream from the first channel; 

receiving the selection map data and the unequal error correction data ftom the 
second channel; 

first error correcting the selected stream portions according to the selection map 
data using the additional unequal error correcting data; 

second error correcting the encoded multimedia data portions using the uniform 
error correction data. 
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16. A multimedia stream transmitter, comprising: 

signal processing means (112): for pioviding a standard multimedia data stream, 
the stream containing encoded multimedia data and uniform error correction data useful for 
error correcting the encoded multimedia data, the uniform error correction data providing 
substantially the same robustness of error correction for each portion of the mcoded 
multimedia data of the standard multimedia data'stream; for selecting some stream portions 
of tiie standard multimedia data stream but not otiier stream portions of tihe standard 
multimedia data stream, the selection depending on the importance of the type of data 
contained in the stream portions to the quality of the presentation of the multimedia data; 
for generating selection map data indicating which of the stream portions were selected; 
and for generating additional unequal error correction data for the selected stream portions 
and not for other stream portions that were not selected; 

transmitting means (1 14) for transmitting the standard multimedia data stream into 
a first chaimel, and for transmitting enhancement data including the selection map data and' 
the additional unequal error correction data into a second chaimel, the second channel 
being different than the first channel. 

17. The transmitter of claim 1 6, wherein the signal processing means includes an input 
terminal (1 10) for providing the standard multimedia data stream. 

1 8. The transmitter of claim 1 6, wherein: 

providing a standard multimedia data stream includes: providing encoded 
multimedia data; generating the uniform error correction data for the encoded multimedia 
data; and generating the standard multimedia data stream containing the encoded 
multimedia data and uniform error correction data. 

19. The transmitter of claim 18, wherein the signal processing means includes an 
encoded irput terminal (1 10) for providing the encoded multimedia data. 

20. The transmitter of claim 1 8, wherein: 

providing encoded multimedia data includes: providing raw multimedia data and 
compressing the raw multimedia data to provide the encoded multimedia data. 
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21. The transmitter of claim 20, wheiein flie signal processing means includes an input 
temainal (110) for providing Hie raw multimedia data. 

22. A multimedia stream transmitter, comprising: 

a receiver (202) for receiidng raw multimedia data; 

an encoder (204) that compresses tibie raw multimedia data for providing encoded 
multimedia data; 

a first error correction generator (206) that generates uniform error correction data 
for the encoded multimedia data, the uniform error correction data providing substantially 
the same robustness of error correction for each portion of the encoded multimedia daU^ 

a multiplexer (208) that formats the encoded multimedia data and the uniform error 
correction data to provide a standard multimedia data stream; 

a selector (210) that selects some stream portions of the standard multimedia data 
stream but not other stream portions of the standard multimedia data stream for additional 
unequal error correction, and that generates selection map data indicating which of the 
stream portions were selected for additional unequal error correction, ttie selection 
depending on the importance of the type of data contained in the stream portions to the 
quality of the presentation of the multimedia data; 

a second error correction generator (212) that generates additional imequal error 
correction data for the selected stream portions indicated by the selection map data and not 
for other stream portions that were not selected; 

a first transmitter (220) for transmitting flie standard multimedia data stream into a 
first channel; and 

a second transmitter (222) for transmitting enhancement data including the 
selection map data and the additional imequal error correction data into a second channel, 
tfie second channel being dififerent than the first channel. 

23. A multimedia data stream receiver, comprising: 

receiving means (232) for receiving a standard multimedia data stream from a firat 
chaimel, the standard stream containing encoded multimedia data and uniform error 
correction data; and for receiving enhancement data including selection map data and 
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unequal error correction data from a second channel die second channel being different 
dian die first channel; 

processing means (234) for first error correcting portions of the standard stream 
according to the selection map data using the additional unequal error correction data, the 
selection map data indicating ttiat some portions of the standard stream are to be corrected 
in the first correcting and other portions of the standard stream are not be corrected in die 
first correcting; and for second error correcting all the encoded multimedia data using die 
uniform error correction data, die uniform error correcting providing substantially die same 
robustness of error correction for each portion of the multimedia data of the standard 
strean^and 

transmission means (236) for transmitting the error corrected encoded multimedia 
data after the first and second error correcting of the data. 

24. A multimedia data stream receiver, comprising: 

a first receiver (254) that receives a standard multimedia data stream from a first 
channel, the standard stream containing encoded multimedia data and uniform error 
correction data for error correction of the encoded multimedia data, the uniform error 
correction data providing substantially the same robustness of error correction for each 
portion of the encoded multimedia data; 

a second receiver (252) diat receives enhancement data including selection map 
data and additional unequal error correction data from a second charmel; the second 
receiver also receiving third error correction data from the second charmel; the second 
channel being a different channel than the first channel; 

a first error correction unit (256) that error corrects the enhancement data using the 
third error correction data; 

a second error correction unit (258) that provides a first error correcting of portions 
of die standard data stream according to the selection map data using the additional 
unequal error correction data; 

a third error correction unit that provides a second error correcting of the CTCoded 
multimedia data using the uniform error correction data; 

an output (262) for transmitting the error corrected encoded multimedia data after 
the first and second error correcting of the data. 
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25. Related signals comprising: 

a standaid multimedia data stream (120) in a first channel, fhe standard stream 
containing encoded multimedia data and uniform error correction data usefid for error 
correcting fhe encoded multimedia data, tiie uniform error correction data providing 
substantially fhe same robustness of error correction for each portion of the encoded 
multimedia data of the standard stream; and 

enhancement data (1 30) in a second channel, die enhancement data including 
selection map data (136,142) and additional unequal error correction data (137,144), the 
selection map data being an indication of which portions of the standard stream are to be 
corrected using the additional unequal error correction data and which other portions of fhe 
standard stream are not to be corrected using the additional unequal error correction data, 
fhe second chaimel being a different channel than the first channel* 

26, A medium (140,141) contammg the related signals of claim 25 in different 
respective channels of fhe medium. 
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ABSTRACT 

In a transmitter, a standard stream of encoded multimedia data and uniform error 
correction data is transmitted through a first channel. The uniform error correction data 
5 provides substantially the same error correction for all portions of ttie encoded multimedia 
data. Simultaneously, additional unequal error correction data is generated for critical 
portions of the standard stream and not for other portions of the standard stream, and the 
additional error correction data is transmitted through a second channel. In a receiver, the 
additional error correction data is used to error correct just the critical portions of the 
10 standard stream, and then the uniform error correction data is used to error correct all the 
portions of the encoded multimedia data of the standard stream. 
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